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(54) Cmos active pixel image sensor with extended dynamic range and sensitivity 



(57) A semiconductor based X-Y addressable imag- 
er having an imaging array with a plurality of the pixels 
within the X-Y addressable imager, a photodetector 
within each of the plurality of pixels configured to sense 
a first bandwidth of light, a sense node within each of 
the pixels configured to sense a second bandwidth of 
light, a reset mechanism operatively configured to the 
photodetector and the sense node to allow resetting 
each of the photodetector and the sense node to a pre- 
determined potential, the sense node being formed 
such that it does not have a light shield allowing the 



sense node to act as a second photodetector. and a 
transfer mechanism within each of plurality of pixels 
configured to transfer charge from the photodetector to 
the sense node. The X-Y addressable sensor in this em- 
bodiment can have either the first and second band- 
widths being different, or the first and second band- 
widths are the same. 

Another embodiment envisions the X-Y addressa- 
ble imager is formed such that the bandwidth detected 
by the sense node and the photodetector is the same 
allowing for increased dynamic range of the photode- 
tector. 
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Description 

[0001 ] The present invention pertains to semiconduc- 
tor based image sensors and more particularly to Active 
Pixel image sensors (APS) having high sensitivity and 
increased dynamic range. 

[0002] APS are solid state imagers wherein each pixel 
contains both a photosensing means and at least one 
other active component, creating a charge that is con- 
verted to a signal (either a voltage or current signal). 
The signal represents the amount of light incident upon 
a pixel photosite. The dynamic range (DR) of an imaging 
sensing device is defined as the ratio of the effective 
maximum detectable signal level, typically referred to as 
the saturation signal, (V sat ), with respect to the rms. 
noise level of the sensor, (a^). This is shown in Equa- 
tion 1. 

Equation 1: Dynamic Range = V^/ 

[0003] Image sensor devices such as charge coupled 
devices (CCD) that integrate charge created by incident 
photons have dynamic range limited by the amount of 
charge that can be collected and held in a given pho- 
tosite, (V Mt ). For example, for any given CCD, the 
amount of charge that can be collected and detected In 
a pixel is proportional to the pixel area. Thus for a com- 
mercial device used in a megapixel digital still camera 
(DSC), the number of electrons representing Vsat is on 
the order of 13,000 to 20,000 electrons. If the incident 
light is very bright and creates more electrons that can 
be held in the pixel or photodetector, these excess elec- 
trons are extracted by the anti-blooming means in the 
pixel and do not contribute to an increased saturation 
signal. Hence, the maximum detectable signal level is 
limited to the amount of charge that can be held in the 
photodetector orpixel. The DR is also limited by the sen- 
sor noise level, c^^. Due to the limitations on Vsat, 
much work has been done in CCD's to decrease 
to very low levels. Typically, commercial megapixel DSC 
devices have a DR of 1 000:1 or less. 
[0004] The same limitations on DR exist is for APS 
devices. The V^ is limited by the amount of charge that 
can be held and isolated in the photodetector. Excess 
charge is lost. This can become even more problematic 
with APS compared to CCD due to the active compo- 
nents within the pixel in the APS, limiting the area avail- 
able for the photodetector, and due to the low voltage 
supply and clocks used in APS devices. In addition, 
since APS devices have been used to provide image 
sensor systems on a chip, the digital and analog circuits 
used on APS devices such as timing and control and 
analog to digital conversion, that are not present on 
CCD's, provide a much higher noise floor on APS de- 
vices compared to CCD. This is due to higher temporal 
noise as well as possibly quantization noise from the on- 
chip analog to digital converter. 



[0005] In commonly assigned U.S. Patent application 
09/426,870, Guidash explains the prior art approaches 
to extending dynamic range of APS devices, and dis- 
closes a new invention to extend dynamic range by col- 
5 lection of the charge that blooms from the photodetector. 
While that approach does provide extended dynamic 
range with a small pixel, it has the potential disadvan- 
tage of spatial variation of the photodetector saturation 
level contributing to fixed pattern noise in the sensor, 
10 and does not increase the sensitivity of the sensor. 
[0006] Prior art APS devices also suffer from poor 
sensitivity to light due to the limited fill factor induced by 
integration of active components in the pixel, and by loss 
of transmission of incident light through the color filter 
15 layer placed above the pixel. 

[0007] From the foregoing discussion it should be ap- 
parent that there remains a need within the prior art for 
a device that retains provides extended dynamic range 
while retaining low fixed pattern noise, small pixel, and 
20 high sensitivity. 

[0008] According to the present invention, there is 
provided a solution to problems of the prior art. In the 
present invention, the floating diffusion region in each 
pixel is used as a separate photodetector region to pro- 
25 vide extended dynamic range and high sensitivity. 
[0009] A first embodiment of the present invention 
provides extended dynamic range and higher sensitivity 
by utilizing a floating diffusion region without a light 
shield provided in each pixel as a separate photodetec- 
30 tor region. During integration of signal charge on the 
photodetector, charge is also collected on the floating 
diffusion in proportion to the light incident on the floating 
diffusion region. In prior art devices the floating diffusion 
region is used as the charge to voltage conversion node, 
35 as an overflow drain for the photodetector during inte- 
gration, or as a charge storage region for global frame 
capture. As a resuit, the floating diffusion region is either 
shielded from incident light, or is held in a reset mode 
to prevent the accumulation of charge resulting from 
40 light incident on or near the floating diffusion region, and 
to drain the blooming charge from the photodetector 
region . In the present invention charge is integrated on 
the floating diffusion in proportion to the amount of light 
incident upon the floating diffusion for a period of time 
45 that is controlled independently from the photodetector 
integration time. The charge integrated on the floating 
diffusion is then read out separately from the charge in- 
tegrated on the photodetector. In this first embodiment 
the photodetector and floating diffusion in a given pixel 
50 are covered by the same color filter, or are both not cov- 
ered by any color filter. 

[001 0] A second embodiment of the present invention 
provides extended dynamic range and high sensitivity 
to incident light by utilizing the first embodiment with a 
55 different or separate color filter for the photodetector and 
floating diffusion region in a given pixel. This provides a 
signal charge associated with 2 colors per pixel. 
[0011] According to the present invention, an active 
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pixel sensor device that significantly increases the dy- 
namic range and sensitivity of the device, and can be 
used in current system designs is provided by: an X-Y 
addressable imager having a plurality of the pixels within 
the X-Y addressable imager with a photodetector within 
each of the plurality of pixels configured to sense a first 
bandwidth of light; a sense node within each of the pixels 
configured to sense a second bandwidth of light; a reset 
mechanism operatively configured to the photodetector 
and the sense node to allow resetting each of the pho- 
todetector and the sense node to a predetermined po- 
tential, the sense node being formed such that it does 
not have a light shield allowing the sense node to act as 
a second photodetector; and a transfer mechanism 
within each of plurality of pixels configured to transfer 
charge from the photodetector to the sense node. The 
first and second ban dwldths can be different or the same 
depending upon design choices. The X-Y addressable 
imager is envisioned as comprising a system with a first 
storage mechanism to store a signal associated with 
charge accumulated on the sense node, a second stor- 
age mechanism to store a signal associated with charge 
accumulated on the photodetector and a timing circuit 
for controlling the integration and transfer timing of the 
sense node and the photodetector for each of the plu- 
rality of pixels. 

[0012] The invention has the following advantages. It 
provides for extending the dynamic range and sensitivity 
of a sensor that can easily be employed within current 
sensor and pixel designs with little or no modification. 
Small pixels with high fill factor can provide separate sig- 
nals from 2 colors per pixel. 

Fig. 1a is a diagram of a pixel of a first embodiment 
of the present invention that extends the dynamic 
range by Integration of photoelectrons created from 
incident photons on both the photodetector and 
floating diffusion; 

Fig. 1b is a diagram of a pixel of a first embodiment 
of the present invention shown in Fig . 1 a further de- 
tailing the per column signal processing; 
Fig. 2 is a timing diagram for the pixel shown in Fig. 
1b; 

Fig. 3a illustrates a pair of transfer functions for the 
pixel in Fig. 1b operated by the timing diagram 
shown in Fig. 2 having a short floating diffusion in- 
tegration time leading to a small slope for linear re- 
gion 2; 

Fig. 3b illustrates a pair of transfer functions for the 
pixel in Fig. 1b operated by the timing diagram 
shown in Fig. 2 having a relatively longer floating 
diffusion integration time leading to a larger slope 
for linear region 2; 

Fig. 4 is a timing diagram for the pixel shown in Fig. 
1b; and 

Fig. 5 is a diagram of a pixel of a second embodi- 
ment of the present invention that extends the dy- 
namic range by integration of photoelectrons creat- 



ed from incident photons on both the photodetector 
and floating diffusion. - - 

[0013] The first embodiment of the present invention 

5 provides extended dynamic range and highersensitlvity 
by utilizing a floating diffusion region without a light 
shield provided in each pixel as a separate photodetec- 
tor region. During integration of signal charge on the 
photodetector, charge is also collected on the floating 

10 diffusion in proportion to the light incident on the floating 
diffusion region. The integration time of the floating dif- 
fusion region is controlled independently from that of the 
photodetector. This is accomplished using the pixel 
shown in Figs, la and 1b. This is a similar pixel design 

15 to that disclosed by Guidash in commonly assigned U. 
S. Patent applications 09/426,870 and 09/1 30,665. This 
pixel 10 comprises a photodetector 12 (preferably a 
pinned photodiode P), a transfer gate 1 6, a floating dif- 
fusion 1B, a row select transistor 7, a reset transistor 

20 comprised of a source being the floating diffusion 18, 
reset gate 1 7 and reset drain 1 9 t and a lateral overflow 
region 6. 

[0014] Fig. lb is a diagram of a pixel of a first embod- 
iment of the present invention shown in Fig. la further 

25 detailing the per column signal processing. The pixel 1 0, 
illustrated in Fig. lb, is preferably part of an X-Y address- 
able array of pixels that are arranged In row and col- 
umns. Typically, the readout of charge accumulated 
within the pixels is accomplished by selecting one row 

30 at a time and readout out the columns within that row. 
Each column will have circuits for processing the out- 
puts of the individual pixels. The column circuits envi- 
sioned by the present invention are transistors 1 , 2, and 
3 which operate as switches under control of gate sig- 

35 nals SHS pd , SHR and SHS fd to store signals within, re- 
spectively, capacitors C 4 , C 5 , and C 6 . The signals from 
pIxeMO that are stored under control of SHS^, SHR 
and SHS fd within capacitors C 4 , C 5 , and C 6 are used as 
inputs to differential amplifiers 31 , 32 which compare a 

40 reset value for the floating diffusion 1 8 with the accumu- 
lated signal values from each of the floating diffusion 1 8 
and the photodetector 12. 

[0015] Operation of the first embodiment of the 
present invention is shown in the timing diagram of Fig. 

45 2 for the pixel 10 of Fig. 1b, resulting in the output signal 
transfer function shown in Figs. 3a and 3b. Referring to 
Fig. 2, the pixel 10 is reset or initialized by transferring 
charge from the photodetector 12 to the floating diffu- 
sion 18 by pulsing of the transfer gate 16 (shown as sig- 

50 nal TG) on and off, and the subsequent resetting of the 
floating diffusion 1 8 by the activation of reset gate 1 7 
which resets the floating diffusion 18 to a potential de- 
termined by the reset gate pulse width, reset transistor 
threshold voltage, and potential of the reset drain 19. 

55 The photodetector integration time (t^j) commences 
when the transfer gate 1 6 is turned off after the initiali- 
zation or reset sequence. The reset gate is left on. The 
electrostatic potential of the lateral overflow region is set 
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at a level deeper than the transfer gate off potential so 
that excess charge in the photodetector will bloom 
through the lateral overflow region and into the reset 
drain of the adjacent pixel. The overflow mechanism 
prevents charge from blooming into the floating diffusion s 
and corrupting the charge accumulated on the floating 
diffusion. The overflow mechanism can be any means 
known within the art. As photodetector integration time 
(*intpd) proceeds, the floating diffusion can also begin in- 
tegration. The floating diffusion integration time com- 10 
mences when the reset gate is turned off. The amount 
of time elapsed between turning off the reset gate and 
the resetting of the floating diffusion is referred to as the 
floating diffusion integration time, t Jntfd . At the end of de- 
sired photodetector integration time, tj nlpd , the level of is 
charge integrated on the floating diffusion 1 8 is sampled 
and held by pulsing SHS fd which places the floating dif- 
fusion 1 8 signal on Capacitor C 4 , followed by a reset of 
the floating diffusion 1 8 by RG and a sample and hold 
of the reset level by SHR which places the floating dif- 20 
fusion reset level on Capacitor C 5 . Charge is then trans- 
ferred from the photodetector 12 to the floating diffusion 
1 8 by pulsing TG 1 6 on and off, and that signal level is 
then sampled and held by SHS^ and placed on Capac- 
itor C 6 . The sampled and held signal levels from the pho- 25 
todetector and the floating diffusion can then be added 
in the voltage domain to provide a total signal. One ex- 
ample of this is shown in Fig. 1b. The present invention 
envisions a differential readout for the floating diffusion 
signal on capacitor C^ and the reset level on capacitor 30 
C 5 via differential amplifier 31 , and a second differential 
readout for the photodetector signal level on capacitor 
C 6 and the reset level on capacitor C 5 via differential 
amplifier 32, thus providing true correlated double sam- 
pling for the photodetector signal level. The final output 35 
signal can then be determined by several means. One 
is reading the signals from the two differential amplifiers 
31 and 32 separately providing two signal values per 
pixel that can be added off-chip. A second embodiment 
is accomplished by providing the signals as inputs to a *o 
third amplifier and subsequent signal processing chain 
in order to read out the signal out as a single level per 
pixel. This readout method of combining the signal in 
the voltage domain also provides a larger maximum pix- 
el signal level Vmax than combining the signals in the 45 
charge domain. This is because the floating diffusion 
does not have to hold the integrated photodetector sig- 
nal and integrated floating diffusion signal simultane- 
ously. Hence the Vmax is extended to be the full floating 
diffusion capacity plus the photodetector capacity. 50 
[0016] Since this method utilizes differential readout 
of the pixel with respect to a reference reset level, the 
pixel offset noise is cancelled. Additionally the dynamic 
range is extended without any additional components in 
the pixel, so that it can be accomplished with small pixels 55 
that are practical for low cost consumer digital imaging 
applications. The sensitivity of the pixel is increased 
since both the floating diffusion and photodetector are 



used for integration, providing a larger photoactive area 
in the pixel. Since the floating diffusion is integrating 
charge created from light incident on the floating diffu- 
sion rather than collecting charge that blooms from the 
photodetector, fixed pattern noise from variation of the 
point at which charge blooms from the photodetector is 
eliminated. With this approach pixel read noise of 
charge integrated on the floating diffusion will be in- 
creased due to the reset level being uncorrelated to the 
floating diffusion signal level. This will be typically less 
than 30 electrons and is small compared to the gain in 
effective signal level. 

[0017] As a result of the operation described for Fig. 
2 the sensor output response will be as shown in Figures 
3a and 3b. The output response comprises two regions. 
For low light levels the output response will follow linear 
region 1. The slope of linear region 1 is a superposition 
of the responses provided by the photodetector and the 
floating diffusion, and is proportional to the integration 
time of both the photodetector and floating diffusion. As 
the number of photoelectrons exceeds the capacity of 
the photodetector, this charge will flow through the lat- 
eral overflow region and be removed via the reset drain 
or VDD of the adjacent pixel. The photodetector signal 
charge will saturate at this point referred to as V pdsat . At 
this point the pixel output response will follow linear re- 
gion 2. The preferred embodiment provides a linear re- 
sponse in linear region 2, by the timing shown in Fig. 2. 
The slope of linear region 2 is dependent on and directly 
proportional to the floating diffusion integration time t^. 
H . The two Figures (3a and 3b) illustrate the two different 
slopes for linear region 1 and linear region 2. The float- 
ing diffusion integration time in Fig. 3a is shorter than 
that for Fig 3b. Consequently, the slope of linear region 
1 and linear region 2 in Fig 3b is greater than that for 
Fig. 3a. 

[0018] The dynamic range is extended in two ways. 
First, since the floating diffusion region is used to inte- 
grate and store photoelectrons, the maximum capacity 
of electrons is larger than just using the photodetector. 
Second, by using different integration times for the pho- 
todetector and floating diffusion regions, an effective or 
extrapolated signal level, Veff, can be determined from 
the ratio of the integration times of the photodetector and 
floating diffusion, the ratio of responsivities of the pho- 
todetector and floating diffusion, and the measured sig- 
nal level from each. Since the ratio of the photodetector 
integration time t^ to the floating diffusion integration 
time t intfd can be made large, Veff can be increased sub- 
stantially over the signal limited by the photodetector 
and floating diffusion capacity. 

[0019] It is also possible to display the sensor output 
signal directly without determining the effective signal 
level from linear region 2. This still provides extended 
instrascene dynamic range by mapping and directly dis- 
playing a larger incident illumlnant range into the directly 
detectable signal voltage range. This direct output re- 
sponse is what is illustrated in Figs. 3a and 3b. 
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[0020] The timing diagram shown in Fig. 2 shows the 
preferred embodiment of separate readouts of the 
charge on the floating diffusion and the photodetector. 
In this case, the signals are combined in the voltage do- 
main. The readout could also be accomplished via a sin- 5 
gle readout where the signal charge in the photodetector 
is transferred to the floating diffusion and the combined 
charge is readout as shown in Fig. 4. This has the ad- 
vantage of a single readout and thus faster readout time, 
but has the disadvantage of smaller effective charge ca- 1 o 
parity, and an uncorrrelated differential readout. 
[0021] The second embodiment of the present inven- 
tion utilizes the method of separate readouts of charge 
from the floating diffusion 28 and photodetector 22 com- 
bined with two different color filters 1 and 2 provided 13 
over the photodetector 22 and floating diffusion 28 with- 
in a given pixel 20. This is shown in Fig. 5. With this 
invention, signal levels associated with two different 
colors can be obtained and separately quantified from 
each pixel site. Referring to Fig. 5, the second embodi- 20 
ment of the present invention is illustrated wherein 
charge that has accumulated on the floating diffusion 28 
is stored on capacitor C 6 by timing signal SHS fd . In a 
manner consistent with the timing diagram shown in Fig. 
2, the reset signal is applied to the reset gate (RG) 27 25 
after the SHS fd signal resulting in a reset of the floating 
diffusion 28 and that potential level of the floating diffu- 
sion 28 is then stored on capacitor C 5 by application of 
timing signal SHR. Charge that has accumulated within 
the photodetector 22 is then transferred to the floating 30 
diffusion 28 by timing signal TG. This photodetector 22 
charge on the floating diffusion 28 is then stored on ca- 
pacitor C 4 by activation of the timing signal SHS Pd . The 
preferred embodiment of the present invention envi- 
sions that a differential readout be employed to read the 35 
floating diffusion 28 signal level of color filter 1 on ca- 
pacitor C 4 using the reset level on capacitor C 5 as a ref- 
erence input into differential amplifier 31 . A second dif- 
ferential readout for the photodetector 22 signal level of 
color filter 2 on capacitor C 6 via differential amplifier 32 40 
with the reset level on capacitor C 5 again as the refer- 
ence input, thus providing true correlated double sam- 
pling for the photodetector 22 signal level. The final out- 
put signal can then be determined by several means. 
One is reading the signals from the two differential am- *s 
plifiers 31 and 32 separately providing two signal values 
per pixel that can be added off-chip. It is envisioned that 
the output of the second embodiment be derived by pro- 
viding the colorfilter 1 and color filter 2 signals as inputs 
to a third amplifier and signal processing chain to read so 
out the signal out as a single color difference level per 
pixel. This could also be done in any manner that pro- 
vided either a color difference or color addition in the 
analog voltage domain per pixel, or any manner that us- 
es the two color signals from within a single pixel or from ss 
neighboring pixels to obtain a desired combination of 
those signals. 

[0022] Another method of deriving the final output sig- 



nal within the second embodiment is to have one of the 
colors be representative of white light. In this version of 
the second embodiment the color filter would actually 
be an empty space over either the floating diffusion 28 
or the photodetector 22, Preferably, the empty space is 
created over the floating diffusion 28 or photodetector 
22 by having no color filter thus yielding a white filter. 
Because the white filter would accumulate photoelec- 
trons faster than the color filter over the photodetector 
22 or floating diffusion 28, the sensitivity of the pixel 20 
can be increased while maintaining a color signal asso- 
ciated with each pixel 20. With this method the image 
sensor could be used as either a color or monochrome 
sensor. 

[0023] Another method is to provide a green color fil- 
ter associated with the photodetector or floating diffu- 
sion region in each pixel. In this embodiment, a more 
accurate luminance sample per pixel can be created. 
Prior art devices will typically create the luminance 
channel at each pixel from interpolation of color filtered 
light samples of adjacent pixels. This can provide lower 
noise images since noise associated with color filter in- 
terpolation will not be present. Also, digital imaging tech- 
niques can be expanded and altered to employ the fea- 
tures provided by the present invention. 
[0024] Although not shown In the diagrams this ap- 
proach can be done with many variations obvious to 
those skilled in the art. For example, the photodetector 
could be a photogate, the reset transistor could be re- 
placed by any reset means, the lateral overflow region 
could be a lateral overflow gate, or other overflow 
means, the row select transistor could be replaced by 
any row select means. Each pixel could have a different 
color pair. 



Claims 

1. A semiconductor based X-Y addressable imager 
having an imaging array comprising a plurality of 
pixels: 

at least one pixel within the X-Y addressable 
imager having a photodetector configured to sense 
a first bandwidth of light, a sense node the pixel con- 
figured to sense a second bandwidth of light, a reset 
mechanism operatively configured to the photode- 
tector and the sense node to allow resetting each 
of the photodetector and the sense node to a pre- 
determined potential, the sense node being formed 
such that it does not have a light shield allowing the 
sense node to act as a second photodetector and 
a transfer mechanism within the pixel configured to 
transfer charge from the photodetector to the sense 
node. 

2. The X-Y addressable sensor of claim 1 wherein the 
first and second bandwidths are different 
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3. The X-Y addressable sensor of claim 1 wherein the 
first and second bandwidths are the same. 

4. The X-Y addressable imager of claim 1 wherein the 
imaging array is further placed within a system com- 5 
prising: 



a first storage mechanism to store a signal as- 
sociated with charge accumulated on the sense 
node; 

a second storage mechanism to store a signal 
associated with charge accumulated on the 
photodetector; and 

a timing circuit for controlling the integration 
and transfer timing of the sense node and the 
photodetector for the pixel. 
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5. The system of claim 4 wherein the timing mecha- 
nism further comprises a sense node sampling sig- 
nal to store a sense node signal proportional to the 
charge that has accumulated in the sense node 
within the first storage mechanism, a reset signal to 
reset the sense node after charge accumulated in 
the sense node has been stored in the first storage 
mechanism, a transfer signal to transfer charge ac- 
cumulated within the photodetector to the sense 
node after the sense node has been reset by the 
reset signal and a photodetector sampling signal to 
store a photodetector signal that is proportional to 
charge that has accumulated in the photodetector 
within the second storage mechanism. 

6. The system of claim 5 further comprising a reset 
storage device and wherein the timing mechanism 
further comprises a reset sampling signal to sample 
a reset potential of the sense node for each of the 
plurality of pixels and a circuit capable of determin- 
ing the difference between the sampled reset po- 
tential and either the first or second storage mech- 
anisms. 

7. The system of claim 4 further comprising a reset 
storage device and wherein the timing mechanism 
further comprises a reset sampling signal to sample 
a reset potential of the sense node for each of the 
plurality of pixels and a circuit capable of determin- 
ing differences between the sampled reset potential 
and both the first storage means and the second 
storage means. 

3. A semiconductor based X-Y addressable MOS im- 
ager comprising a plurality of pixels: 

at least one pixel within the X-Y addressable 
MOS imager having a photodetector, a sense node 
within the pixel coupled to the photodetector 
through a transfer mechanism, a reset mechanism 
operatively configured to the photodetector and the 
sense node to allow resetting each of the photode- 
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tector and the sense node to a predetermined po- 
tential, and wherein the sense node is formed such 
that it does not have a light shield allowing the sense 
node to act as a second photodetector, and the pixel 
further comprising a transfer mechanism config- 
ured to transfer charge from the photodetector to 
the sense node. 

The X-Y addressable MOS imager of claim 8 where- 
in the imager is placed within a system, the system 
further comprising: 

a first storage mechanism used to store a signal 
level associated with charge accumulated on 
the photodetector; 

a second storage mechanism used to store a 
signal level associated with charge accumulat- 
ed on the sense node; and 
a timing circuit for controlling the integration 
and transfer timing of the pixel. 
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